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[57] ABSTRACT 

Amethod and apparatus for merging, displaying and access- 
ing PC content listings via a television user interface are 
disclosed. At least one PC content listing is formatted into a 
television content listing format and the PC content listing is 
then displayed on a display device. According to one aspect 
of the invention, the PC content listing may be merged with 
at least one television content listing. According to another 
aspect of the invention, a command is input into a remote 
control, the command is transmitted from the remote control 
to a processing unit, the processing unit interprets the 
command into a corresponding action, and the correspond- 
ing action is executed to present PC content listings on a 
display device via a television user interface. 
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METHOD AND APPARATUS FOR MERGING, nel up or down from the channel that the user is currently 

DISPLAYING AND ACCESSING PERSONAL watching. This television user interface is one that is widely 

COMPUTER CONTENT LISTINGS VIA A known and used and one that is easily and intuitively learned 

TELEVISION USER INTERFACE by users. Availability of this type of an intuitive user 

5 interface for the PC would therefore enable novice users to 

FIELD OF THE INVENTION use PC functionality and encourage them to access PC 

The present invention relates to the field of computing. content °° a m °* basis - In a ^ itio ( n k to ia ^ &v % 

Specifically, the present invention discloses a method and ™* a televKion also provtdes the advantage of 

apparatus for merging, displaying and accessing personal generally being in a family room, where many people spend 

computer (PC) content listings via a television user inter- «> ™>st of their time rather than in a den or a work space, 

^ c where most households have PCs. 

DESCRIPTION OF RELATED ART SUMMARY OF THE INVENTION 

Currently, home PCs are used for only a few hours a day. The present invention discloses a method and apparatus 
This is true despite the recent growth of applications and 15 for merging, displaying and accessing PC content listings 
advances in networking technology that have made the via a television user interface. At least one PC content listing 
World Wide Web ("the Web") increasingly popular to a large is formatted into a television content listing format and the 
segment of the population. Many people are intimidated by PC content listing is then displayed on a display device, 
the non-intuitive PC user interface, such as a Microsoft According to one aspect of the invention, the PC content 
Windows™ user interface, that requires specialized PC 20 listing may be merged with at least one television content 
knowledge. For example, a Microsoft Windows™ user is listing. According to another aspect of the invention, a 
generally familiar with concepts such as point and click, command is input into a remote control, the command is 
double clicking and pull down menus. These concepts are transmitted from the remote control to a processing unit, the 
not intuitive for a novice user who has little or no PC processing unit interprets the command into a corresponding 
experience. As such, many users who may otherwise be able 25 action, and the corresponding action is executed to present 
to derive value from a PC, including accessing the Web, are PC content on a display device via a television user inter- 
currently inhibited by their tack of PC knowledge, and/or face. 

their lack of interest in learning how to use the existing PC Other objects, features and advantages of the present 

user interfaces in order to access PC content. ^ invention will be apparent from the accompanying drawings 

FIG. 1A illustrates an example of the current PC content and from the detailed description, 
access model. PC 100 includes a display 105 that comprises 

window 110 (including buttons 1-5), icons 1 and 2 and BRIEF DESCRIPTION OF THE DRAWINGS 

cursor 115. Cursor 115 is associated with mouse 125 that present invent j s illustrated by way of example 

controls the activity within display 105. Icon 1 allows users 35 md not limitation ^ me figures of the accompanying 

to discard information by "dragging" a visual image of the drawings, in which like references indicate similar elements 

information into the visual image of the trash can, or by anc j m wn i Cfl . 

selecting a "delete" option in an application, where avail- a ^ pc ^ 

able. 

j i-» , v . - . „, anU *. FIG. IB illustrates a prior art television user interface. 

Icon 2 represents an application which a user may open by 40 r 

single or double clicking on the visual image of the icon in FIG- 2 illustrates a computer system that may be utilized 

a manner well-known in the art. Once the application is m the present invention. 

activated, an application window such as window 110 may FIG. 3A illustrates a prior art television program listing 

appear. If the user then desires to select button 1 within available on a television. 

window 110, the user utilizes mouse 125 to send commands 45 FIG. 3B illustrates one embodiment of the present inven- 

to PC 100. The user selects button 1 by positioning cursor uon ^ implemented in a television program listing. 

115 over button 1 of window 110 and single or double mQ 4 mustratcs one embodiment of a system utilizing 

clicking on the button. The single or double clicking action ^ present invention, 

activates button 1 to perform specific tasks associated with ... 

, . . - v r FIG. 5A illustrates in more detail one embodiment of the 

button 1. 50 

. , a 1 1. 1 • j .« -t present invention. 

Although the single and double clicking action described r _ r j 4 . wu , . . 

above is well known in the art, the action is not intuitive to ™- 5B mustrates m morc detai1 thc °°*mand interpreter 

a novice user, and has to be learned in order for the user to of me P rescnt invention. 

be productive. As described above, this learning intimidates FIG. 5C illustrates in more detail the dispatcher of the 

a number of potential PC users and discourages users from 55 P^sem invention. 

accessing the PC content via currently available access FIG. 6 is a flowchart illustrating one embodiment of the 

methods. present invention. 

It is therefore desirable to have an intuitive user interface dftatf pn nF^rRTPTTONr OF THF 

that provides a high degree of user friendliness for people J^££ SSoSSS? 

who lack computer experience. One example of an intuitive 60 PREFERRED EMBODIMENT 

user interface that a large percentage of people are familiar The present invention relates to a method and apparatus 

with is illustrated in FIG. IB. TV 150 includes display 155 for merging, displaying and accessing PC content listings 

on which a user may display a selected channel via different via a television user interface. "PC content" in the context of 

commands through remote control 175. For example, in this application include Internet listings, Web sites, local or 

order to view content on a TV, a user may simply press a 65 on-line games and any other PC content available to PC 

button on remote control 175 that indicates "channel up" or users. It will be apparent to one of ordinary skill in the art 

"channel down." This automatically displays the next chan- that the presently claimed invention is also applicable to 
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numerous other types of PC content. In the following modem. It will be apparent to one of ordinary skill in the art 

detailed description, numerous specific details are set forth that other network devices and modes of communication 

in order to provide a thorough understanding of the present may also be utilized. 

inventioa It will be apparent to one of ordinary skill in the One embodiment of the present invention is implemented 
art, however, that these specific details need not be used to 5 as a software module, which may be executed on a computer 
practice the present invention. In other instances, well- system such as computer system 200 in a conventional 
known structures, interfaces and processes have not been manner. Using well known techniques, the application soft- 
shown in detail in order not to unnecessarily obscure the ware of one embodiment is stored on data storage medium 
n resent invention and subsequently loaded into and executed within 
-™ ~ / • , . • L . . 1fl computer system 200. Once initiated, the software of the 
FIG. 2 illustrates a typical computer system 200 in which 10 ^ embodiment ^ m (he manner described 

the present invention operates. The preferred embodiment of below 

the present invention is implemented on an IBMv Personal nG 3A a i(jr ^ lel6vision ^ 

Computer manufactured by IBM Corporation of Armont avaflabk for ^ on * televisioQ ^ tt ^ m * 

N.Y. It will be apparent to those of ordinary skill in the art ^ fa ^yja, jy 150, within display 155 and 

tob loTd C ' archltectures 15 generaUymcMes a column indicative of the channel and a 

3 P j * row indicative of a time slot For example, the television 

In general, such computer systems as illustrated by FIG. program listing indicates that on channel 4, for example, the 

2 comprise a bus 201 for communicating information, a television show "SHOW3" can be viewed between 8:00 and 

processor 202 coupled with the bus 201 for processing 8:30. It wiU be apparent to one of ordinary skill in the art that 

information, main memory 203 coupled with the bus 201 for other f ormats may a is 0 be available for the television 

storing information and instructions for the processor 202, a program listing display. 

read-only memory 204 coupled with the bus 201 for storing ^ it[tvisioQ program ij stmg & generally well known to 
static information and instructions for the processor 202, a all useB who ^ a television. It ^ we U-known in the art that 
display device 205 coupled with the bus 201 for displaying remole m1ldl 175 ^ n be ^ to send commands to TV 
information for a computer user, an input device 206 15Q m6 ^ ^ television ^ ^ ^ appcar on 
coupled with the bus 201 for communicating information one of the available channels. In this way, a user may easily 
and command selections to the processor 202, and a mass find a television w to determine the program- 
storage device 207, such as a ma^etic disk and associated min avaflaWe fof mat Te ^ QQ ^ mtuitjve ^ interface 
disk dnve, coupled with the bus 201 for storing .information remains ^ samc r ardless of me typc of jy or mc dty in 
and instructions. A data storage medium 208 containing which tfae usef ^ currently m 

digital information is configured to operate with mass stor- F[G 3B Qne embodimem of ^ method ^ 

age device 207 to allow processor 202 access to the digital ^ for me displaying and accessing PC content 

information on data storage medium 208 via bus 201. ^ a J£*o n ^ M ^ one pc 

Processor 202 may be any of a wide variety of general 35 ^tent listing jg formatted into a television content listing 

purpose processors or microprocessors such as the Pen- format ^ pc ^tent listirjg ^ then displayed in a tele- 

tium® microprocessor manufactured by Intel® Corporation. vision program listing format. As illustrated in FIG. 3B, 

It will be apparent to those of ordinary skill in the art, formatted PC content listings can also be merged with 

however, that other varieties of processors may also be used standard television program listings prior to display. Jhis 

in a particular computer system. Display device 205 may be ^ fotin" ^an jnHn a> i^fo fn w^fr page s, o ^frp- mana ^^t . 

a liquid crystal device, cathode ray tube (CRT), or other systems, video conferences, local video games and on-line 

suitable display device. Mass storage device 207 may be a video game s. It will be apparent to one of ordinary skill in 

conventional hard disk drive, floppy disk drive, CD-ROM ^ m that other type of PC content can also be included 

drive, or other magnetic or optical data storage device for m p rogr am listing. 

reading and writing information stored on a hard disk, a 45 For examp i e channe ls 9 and 10 on the program listing in 

floppy disk, a CD-ROM a magnetic tape, or other magnetic FJG 3fi do nQt standard television programming, 

or optical data storage medium. Data storage medium 208 ^ rather dis j information pertaining to Web sites, 

may be a hard disk, a floppy disk a CD-ROM, a magnetic Channel 0 ^ ^ belween g:00 and 9;30 aQ onlme 

tape, or other magnetic or optical data storage medium. game of « GAMEr is taking place. Meanwhile, channel 10 

In general, processor 202 retrieves processing instructions 50 displays a listing for "Museum of Science & Industry/' 

and data from a data storage medium 208 using mass storage corresponding to the www.museum.com website. According 

device 207 and downloads this information into random to one embodiment of the present invention, just as a user 

access memory 203 for execution. Processor 202, then would select channel 4 at 8:00 p.m. in order to view 

executes an instruction stream from random access memory "SHOW3", t he useLmay y-ip-r* channel m at 8:00 p,m, in 

203 or read-only memory 204. Command selections and 55 order to be presented with the Museum of Science & 

information input at input device 206 are used to direct the Industry exhibits. This is the equivalent of a use r on a PC 

flow of instructions executed by processor 202. Equivalent system utilizing a Web browser, entering a URL in order to 

input device 206 may also be a pointing device such as a access www.museum.com. Similarly, channel 9, if selected 

convention al mou s e, trackball, trackpad, joystick, cursor by a user, will display an Gamel . The user selects channels 

control keys and stylus. The results of this processing 60 9 or 10 in the same way that the user of a prior art television 

execution are then displayed on display device 205. system illustrated in FIG. 3A would select any other 

Computer system 200 includes a network device 210 for channel, namely via remote control 175. The user may select 

connecting computer system 200 to a network via a modem the channel either by an "absolute addressing" method, 

or other mode of communication. Network device 210 for namely by entering the number of the channel on the remote 

connecting computer system 200 to the network includes 65 control, or by a "relative addressing" method where the user 

Ethernet devices, phone jacks and satellite links. Network merely hits the "channel up" or "channel down" buttons on 

device 210 generally communicates with a network via a the remote control 
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This merging of television program listings with PC 
content Listings provides users with a simplified, intuitive 
user interface to access content on PCs. Instead of requiring 
a user to leam a PC user interface, the user can now utilize 
a remote control similar to the currently available remote 
control for televisions. The replacement of a standard tele- 
vision set with the system according to one embodiment of 
the present invention will not be apparent to the user because 
standard television programming will be displayed without 
interruptions or modifications. The user simply has more 
information available to him/her via this familiar television 
user interface than he/she did in prior standard television 
systems. 

FIG. 4 illustrates the method and apparatus of the present 
invention in further detail. Display 300 is coupled to pro- 
cessing unit 400 and is controlled via remote control 175. As 
illustrated in FIG. 4, p rocessing unit 400 is capab le of 
making a connection to the Internet. Pr ocessing unit 400" 
may be a computer system such as illustrated in FIG. 2 or 
any other form of processing unit that can perform the 
functions required to access a television channel and a PC. 
Display 300 replaces the television set in the user's living 
room, and can be utilized for all normal television viewing 
as well as to access PC content. 

FIGS. 5A-5C illustrate the functionality provided by 
processing unit 400 in order to implement one embodiment 
of the present invention. FIG. 5A illustrates processing unit 
400 including a command interpreter 500 and a dispatcher 
510. Commands from remote control 175 are processed by 
both command interpreter 500 and dispatcher 510, and the 
output of the processing is displayed on display 300. 

FIG. 5B illustrates the command interpreter 500 in more 
detail. Specifically, command interpreter 500 maintains two 
tables, table 501 and table 502. Table 501 performs the 
function of converting the bits that are received from remote 
control' 175 into a corresponding button on the remote 
control. For example, as illustrated, the bits "0C4P9A" 
correspond to button 1 on the remote control. Unfortunately, 
however, button 1 does not have a meaning to the command 
interpreter 500 until the command interpreter can determine 
the functionality of button 1. Table 502 maintains informa- 
tion that allows command interpreter 500 to translate the 
buttons into their corresponding functionality. For example, 
as illustrated, button 1 corresponds to a "volume up" button, 
Command interpreter 500 thus knows that if it receives bits 
0C4F9A from remote control 175, the user has just pressed 
the "volume up" button on remote control 175. It will be 
apparent to one of ordinary skill in the art that command 
interpreter 500 may also be implemented in other ways that 
achieve the same result as described above. 

FIG. 5C illustrates dispatcher 510 in more detail Dis- 
patcher 510 is a data structure that includes information 
about the type of activity that is available on each of the 
channels displayed in the television program listing in 
display 300. Dispatcher 510 also includes a pointer that 
informs processing unit 400 of the current channel being 
viewed by the user, in this case channel 2 which is a TV 
channel. If the user selects channel 10, for example, the 
pointer will move to channel 10, thus telling processing unit 
400jha tjchan nel 10 is displaying a Web pag e. In this 
situTtionTproiieslilllg Ullil 400 kuuws LliM il li<u> to establish 
a connection t o the Web in order for the user to view the Web 
pa ge selected on chann el 10. It will be apparent to one of 
ordinary skill in the art that dispatcher 510 may also be 
implemented in other ways that achieve the same result as 
described above. 

The above description addresses the scenario of a user 
utilizing an already programmed television program listing. 
When a user attempts to use an embodiment of the present 
invention for the first time, however, PC content listings will 
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not yet be merged with the television program listing. 
During this first session, the user may be presented with the 
cable TV carrier's Web page, for example, that includes 
various PC content and corresponding channels. This Web 
5 page may be pr ese nted on an unused standard TV channel o r 
a '^haniom" channel that will never be utilized by the cabl e 
TV carrier. \ T ie Web page may be presented automatically if 
the caolc lV carrier is adapted to identify itself to the 
system. Otherwise, the user may have to specify its cable TV 
carrier in order to access the carrier's Web page. 

The channels listed are predetermined by the cable TV 
provider, and the user merely selects the content and corre- 
sponding channels that he wishes to include in his own 
j^SflnflTr 71 *^ llgfl 'ng, Additionally, the user can also manually 
add other Web sites or other PC content by typing in the 

15 information, and the additional PC content will be assigned 
a corresponding channel. The user may change these 
assigned channels, if the user so desires. This additional PC 
content is the user's "local" listing, namely a listing that is 
available only to this user. The user's final personalized 

20 listing may look like the listing illustrated in FIG. 3B. The 
listings may also be presented in alternative listing formats. 

The above embodiment presents the user with a single 
merged listing of PC content listings and television program 
listings. Alternately, the user may be presented with two 

25 separate listings on separate channels. In this way, the user 
may be able to utilize a standard television set, without the 
processing capability described in the currently claimed 
invention. The user will, however, still be able to take 
advantage of the TV user interface paradigm described in the 

30 currently claimed invention. 

The cable TV carrier's predetermined channels may be 
downloaded periodically and merged with the user's local 
listing. This downloading process may be scheduled to occur 
automatically in a manner well known in the art The 

35 merging of the downloaded listing with the user's local 
listing can be achieved in a number of ways. For example, 
Intel's Intercast technology may be utilized to transmit the 
cable TV carrier's program listings over the Vertical Blank- 
ing Interval (VBI) portion of the television transmission. 
Similar to a closed-caption transmission, the program listing 

40 is then extracted by a decoder, and processing unit 400 
merges the listing with the user's local listing. 

Alternatively, the cable TV carrier's Web page containing 
the predetermined channel listing may be downloaded to 
processing unit 400. Processing unit 400 then parses the Web 

45 page and merges the parsed information with the user's local 
listing. It will be apparent to one of ordinary skill in the art 
that other methods of merging the information may also be 
utilized. 

FIG. 6 is a flowchart illustrating the entire process 

50 described above. In step 605 a user accesses PC content and 
adds PC content to the TV television program listing in step 
610. In step 615, the TV television program listing displays 
channels corresponding to PC content together with TV 
channels, as illustrated in FIG. 5 A. The user enters com- 

5S mands via a remote control in step 610, and the command 
interpreter intercepts these commands in step 615. The 
command interpreter looks up a first table to convert com- 
mand bits from the remote control to determine correspond- 
ing buttons on the remote control in step 620. The command 
interpreter then looks up a second table to identify the 

60 function corresponding to the button on the remote control 
in step 625. In step 630, the dispatcher receives information 
regarding the function on the remote control button and in 
step 635, the dispatcher looks up a third table to determine 
the current channel and appropriate interpretation of the 

65 function for the current channel. Finally, in step 640, the 
function is executed to present the user with PC content via 
a television user interface. 
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Thus, a method aod apparatus for merging, displaying and said processing unit interpreting said command into a 

accessing personal computer content via a television inter- corresponding action; and 

face is disclosed. executing said corresponding action to present said PC 

I claim. j , . . , ■ • * * content listings on a display device via said television 

1. A method for merging and displaying television content 5 • , _r • u a 
listings with PC content listings of a Personal Computer mterfa <* «?« activity information, wherein said 
CPQ comprising* acUvity information provides regarding the type of 

formatting at least one PC content listing into a television **** ° n of a of chaDnds 00 

content listing format; mformation said display device 

merging said at least one PC content listing with at least 10 . 14 ™ e method according to claim 13 wherein interpret- 

onetelevision content listing; and in 6 said command into said corresponding action further 

displaying said at least one PC content listing on said includes. 

display device with at least one television content converting said command from bits received from said 

listing. remote control into a corresponding button on said 

2. The method according to claim 1 wherein said at least 15 remote control; and 

one PC content listing is displayed on a channel unused by translating said corresponding button into predetermined 

said television content listing. functionality, 

3. The method according to claim 1 further comprising: 15 mctn od according to claim 14 wherein executing 
receiving input from a remote control; and saicJ corresponding action includes performing said pre- 
processing said input to perform a predetermined action. 20 termined functionality of said corresponding button. 

4. The method according to claim 3 wherein processing jh e me thod according to claim 15 wherein perform- 
said input to perform said predetermined action includes ^ ^ predetermined functionality of said corresponding 
processing said input to change a channel button mcni des changing a television channel. 

5. The method according to claim 4 wherein processing 1? ^ mcmod according to claim 16 changing 

said input to change said channel includes selecting one of 25 &aid tclcvision channcl ^ pcrformcd as m ^lute addrcss . 

a group consisting of a Web page, a message management lg> ^ memod accordi to claim 16 wherein changillg 

system, a video conference, a local video-game and an . , . • • L i • <? a ^ 

J ' . , * & said television channel is performed as a relative address, 

on-line video game. ift . ^ e n _ t t 

6. TOe method according to claim 5 wherein the process ^ W«*»s for accessing PC content lutings via a 
of selecting is performed via at eevision user interface. 30 'elevjsion user interface compnsmg: 

7. An apparatus for merging and displaying PC content a display device; 

listings, said apparatus comprising: a processing unit coupled to said display device, wherein 

a processing unit for formatting at least one PC content said processing unit includes information regarding the 

listing into a television content listing format, and type of activity available on each of a plurality of 

merfnr said at least one PC content listing with at least channels on said display device, said plurality of chan- 

one television content listing; and n els including at least one channel comprising PC 

a display device coupled to said processing unit to display content and at least one channel comprising television 

said at least one PC content listing on said display content wherein content listings of said at least one 

device. channel comprising PC content and content listings of 

8. The apparatus according to claim 7 wherein at least one said at least one channel comprising television content 
PC content listing is displayed on a channel unused by said are merged and displayed at said display device; and 
television content listing. a rcmote control coupled to said processing unit for 

9. The apparatus according to claim 7 further comprising: selecting one of said plurality of channels based on said 
a remote control, wherein said processing unit receives 45 content listings, wherein said processing unit receives 

input from said remote control; and a command from said remote control; 

said processing unit processing said input to perform a wherein said processing unit interprets said command into 

predetermined action. a corresponding action and executes said correspond- 

10. The apparatus according to claim 9 further compris- mg act i on ^mg sa i d act ivity information to present 
m g : 50 said PC content listings on said display device, 

said processing unit processing said input to change a 20. The apparatus according to claim 19 wherein said 

channel. processing unit further converts said command from bits 

11. The apparatus according to claim 10 wherein said received from said remote control unit into a corresponding 
processing unit further selects one of a group consisting of button on said remote control and translates said correspond- 
a Web page, a message management system, a video 55 m g button into predetermined functionality, 
conference, a local video-game and an on-line video game. 21. The apparatus according to claim 20 wherein said 

12. The apparatus according to claim 11 wherein said processing unit executes said corresponding action by per- 
processing unit selects via a television user interface. forming said predetermined functionality of said corre- 

13. A method for accessing PC content listings via a sponding button. 

television user interface comprising the steps of: 60 22. The apparatus according to claim 21 wherein said 

inputting a command into a remote control to access a PC processing unit changes a television channel. 

content listing or a television content listing, wherein 23. The apparatus according to claim 22 wherein said 

said PC content listing is merged with and displayed on television channel is changed as an absolute address, 

said television user interface with said television con- 24. The apparatus according to claim 22 wherein said 

tent listing; 65 television channel is changed as a relative address, 
transmitting said command from said remote control to a 

processing unit; * * * * * * 
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